BioNLP'09 Shared Task on
Event Extraction
in conjunction with BioNLP, a NAACL-HLT 2009 workshop, June 4-5 2009, Boulder, Colorado
[Shared Task Home] [Evaluation Methods] [Master Result Table] [Team Profiles] [System Profiles]

Final Evaluation Results
on Transcription events by Ev. Decom. - Approx. Recur. matching

Task 1

------------------------------------------------------------------------------------------------
   TEAM                                 gold (match)   answer (match)   recall    prec.   fscore
------------------------------------------------------------------------------------------------
[ UTurku  ]        Transcription         137 (   50)       78 (   50)    36.50    64.10    46.51
[VIBGhent ]        Transcription         137 (   51)       90 (   51)    37.23    56.67    44.93
[ UTokyo  ]        Transcription         137 (   44)      110 (   44)    32.12    40.00    35.63
[  NICTA  ]        Transcription         137 (   30)       44 (   30)    21.90    68.18    33.15
[ Team 24 ]        Transcription         137 (   36)       89 (   36)    26.28    40.45    31.86
[UAntwerp ]        Transcription         137 (   32)       82 (   32)    23.36    39.02    29.22
[ UNIMAN  ]        Transcription         137 (   20)       31 (   20)    14.60    64.52    23.81
[JULIELab ]        Transcription         137 (   25)       79 (   25)    18.25    31.65    23.15
[  SCAI   ]        Transcription         137 (   23)       62 (   23)    16.79    37.10    23.12
[ConcordU ]        Transcription         137 (   19)       35 (   19)    13.87    54.29    22.09
[ASU+HU+BU]        Transcription         137 (   20)       52 (   20)    14.60    38.46    21.16
[   Cam   ]        Transcription         137 (   17)       30 (   17)    12.41    56.67    20.36
[ UZurich ]        Transcription         137 (   28)      148 (   28)    20.44    18.92    19.65
[UT+DBCLS ]        Transcription         137 (   20)       77 (   20)    14.60    25.97    18.69
[  UNSW   ]        Transcription         137 (   21)      103 (   21)    15.33    20.39    17.50
[ USzeged ]        Transcription         137 (   25)      150 (   25)    18.25    16.67    17.42
[  PIKB   ]        Transcription         137 (   15)       38 (   15)    10.95    39.47    17.14
[ UAveiro ]        Transcription         137 (   21)      112 (   21)    15.33    18.75    16.87
[ Team 09 ]        Transcription         137 (   16)       53 (   16)    11.68    30.19    16.84
[CNBMadrid]        Transcription         137 (   36)      341 (   36)    26.28    10.56    15.06
[ KoreaU  ]        Transcription         137 (   12)       43 (   12)     8.76    27.91    13.33
[CCP-BTMG ]        Transcription         137 (    9)       20 (    9)     6.57    45.00    11.46
[CIPS-ASU ]        Transcription         137 (   15)      133 (   15)    10.95    11.28    11.11
[  UMich  ]        Transcription         137 (   37)      701 (   37)    27.01     5.28     8.83

Task 2

------------------------------------------------------------------------------------------------
   TEAM                                 gold (match)   answer (match)   recall    prec.   fscore
------------------------------------------------------------------------------------------------
[ Team 24 ]        Transcription         137 (   36)       89 (   36)    26.28    40.45    31.86
[UAntwerp ]        Transcription         137 (   32)       82 (   32)    23.36    39.02    29.22
[ASU+HU+BU]        Transcription         137 (   20)       52 (   20)    14.60    38.46    21.16
[UT+DBCLS ]        Transcription         137 (   20)       77 (   20)    14.60    25.97    18.69
[CNBMadrid]        Transcription         137 (   36)      341 (   36)    26.28    10.56    15.06
[CCP-BTMG ]        Transcription         137 (    9)       20 (    9)     6.57    45.00    11.46

Task 3

------------------------------------------------------------------------------------------------
   TEAM                                 gold (match)   answer (match)   recall    prec.   fscore
------------------------------------------------------------------------------------------------